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GABOR FUSION FRAMES GENERATED BY DIFFERENGE SETS 


IRENA BOJAROVSKA AND VICTORIA PATERNOSTRO 


Abstract. Collections of time- and frequency-shifts of suitably chosen generators (Alltop or random vec¬ 
tors) proved successful for many applications in sparse recovery and related fields. It was shown in m that 
taking a characteristic function of a difference set as a generator, and considering only the frequency shifts, 
gives an equaingular tight frame for the subspace they span. In this paper, we investigate the system of all 
time- and frequency-shifts of a difference set in dimension N via the mutual coherence, and compare 
numerically its sparse recovery effectiveness with Alltop and random generators. We further view this Gabor 
system as a fusion frame, show that it is optimally sparse, and moreover an equidistant tight fusion frame, 
i.e. it is an optimal Grassmannian packing. 


1. Introduction 

Gabor frames m. which are collections of time- and frequency- shifts (translations and modulations) 
of a chosen generator, have been shown useful for a variety of applications in signal processing related to 
signals sparse in a Gabor system, for example, model selection (also called sparsity pattern recovery) [4] , and 
channel estimation and identification [22) . A crucial property of a Gabor system is that for any unitnorm 
nonzero generator v G C'^, it constitutes an iV-tight frame Enun]. In the aforementioned applications, two 
main generators have shown to be particularly useful from both a theoretical and practical point of view: 
Alltop and random vectors (see e.g. EH)- The theoretical guarantees come from the near optimal coherence 
properties of the Gabor frames generated by these vectors. 

The problem of hnding frames with optimal (in) coherence (in the sense of achieving the Welch bound, or 
equivalently being equiangular tight frame (ETF)) is of great importance for signal processing applications, 
as well as for other areas of mathematics. One example is coding theory, where one looks for maximum- 
Welch-bound-equality (MWBE) codebooks [5^. Another example is line packing in Grassmannian manifolds, 
where one seeks N lines in the A-dimensional space so that the maximum chordal distance between any 
two lines is minimized m- These equivalent problems are very difficult and analytic constructions are very 
limited, known to date only for certain parameters of N and K (see |15j for a comprehensive overview of 
known results). One example of such constructions comes from combinatorial design theory [14] : if we take 
the so-called difference sets, which are subsets of {0,1,..., A — 1} with K elements with certain properties 
(see Definition 12.31) . and choose K rows of the discrete Fourier transform matrix indexed according to the 
elements of this set - as it was shown in m - we will obtain an ETF of N vectors in dimension K. For 
other large families of ETF inspired from design theory see nang. 

In the first part of the paper, we will view the characteristic function of a different set as an element of 
and investigate the following question: what type of coherence properties does the full system of modulations 
and translations, generated by a difference set exhibit? Here the corresponding optimal packing problem 
is to pack lines in A-dimensional space. Although for some difference sets the mutual coherence can 
be asymptotically small, we will show that achieving the Welch bound for full Gabor frames generated by 
the characteristic function of difference sets is not possible. However, in the light of compressed sensing, 
our numerical results will show that the Gabor measurements generated by some known difference sets are 
suitable for recovering sparse signals, and have a recovery rate of the order of the Gabor measurements 
generated by random or Alltop vectors. 
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Having a redundant system instead of a basis for representation of the signal does often prove helpful 
in order to gain stability, robustness against noise and erasures etc. The search for representations which 
suit the different needs in signal processing led to the development of the powerful concept of fusion frames 
[El [in], which are frame-like collections of subspaces in a Hilbert space. As in the classical frame setting, 
in this framework one is also interested in constructing fusion frames with prescribed optimality properties, 
which include analogous coherence and equiangularity conditions. 

Thus, in the second part of the paper, we view the aforementioned Gabor system as a fusion frame (we 
consider the subspaces of spanned by the modulations of a fixed translation of the generator). We 
will prove that having a difference set as a generator actually allows us to obtain the following desirable 
optimality properties: our fusion frame is tight, optimally sparse, and equidistant. 

At the end, we solve numerically the problem of recovering sparse signals from Gabor frame and Gabor 
fusion frame measurements, generated by difference sets. The sparsity is understood differently in each of the 
cases: in the first case, the signal is a linear combination of a small number of modulations and translations 
of the generator. For Alltop and random generators this problem was considered in ima- The second case 
is fusion sparsity, when the signal which lies in a union of few subspaces (in our case, involving only few 
translations) is measured with a measurement matrix and one would like to recover it using a mixed lill\ 
minimization problem [ 113115 ]. 

The paper is organized as follows. In Section H after introducing the main objects and their basic 
properties, we start with the study of the mutual coherence of the Gabor frame generated by a characteristic 
function of a difference set. We provide a formula which depends on the parameters of the difference sets 
and study the question of achieving the Welch bound. In Section [3] we switch to the properties of the Gabor- 
like fusion frame, generated by a difference set. We prove three important properties of this construction: 
tightness, equidistance, and optimal sparsity. Finally, in Section H we provide numerical experiments to 
demonstrate the effectiveness of both proposed constructions in solving the sparse recovery problem. 


2. Gabor systems generated by difference sets 


2.1. Background. Let us start with a formal definition of a frame. For more details on the theory of finite 
frames, see [Sj. 

Definition 2.1. A family of nonzero vectors in is called a finite frame for C^, if there 

exist constants 0 < A < H < oo such that 

M 

A||a;|p < ^ |(a;,< H||a;|p for all x G (1) 


If A = H is possible in o, then d) = is called an A-tight frame, and if additionally A = H = 1 is 

possible, then it is a Parseval frame. If there exist a constant c such that ||0i|| = c for all f = 1,2,... ,M, 
then $ = is an equal norm frame. If c = 1, $ = is a unit norm frame. If there exists a 

constant c such that \{cj)i, cj)j)\ = c for all i ^ j, then $ = is called an equiangular frame. 

An important quantity that measures the relations between the frame elements is the mutual coherence, 
defined for a frame $ = as 


/i(d>) = max 


\mm\' 


( 2 ) 


On the one hand, it is clear that when M = N and $ is an orthonormal basis, we will have /i($) = 0. On 
the other hand, if there exist two linearly dependent vectors in the system, the mutual coherence will be 
/i(d>) = 1. There is a minimal value that /i can have for a general redundant frame, and it is given by the 
so-called Welch bound [23] . 

M-N 






( 3 ) 
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One interesting and very useful property of the Welch bound is that equality in ([3|) is achieved if and only is $ 
is an equiangular tight frame (ETF) (see [531 Theorem 2.3]). These type of frames are in some sense the best 
(optimally incoherent) redundant frames, but at the same time highly difficult to construct. Furthermore, 
the most common guarantees that one is able to reconstruct sparse vectors from linear measurements (to be 
explained in more details in the last section), rely on having small mutual coherence | 22 | . 

We now proceed to the construction of a particular type of frames, which is build from time-frequency 
shifts of a given vector. 

Definition 2.2. A Gabor system generated by a window g € is the collection 

where Mjg { n ) = e gin -) is the modulation (or frequency-shift) operator and Tkg { n ) = g(n — k) for all 
n = 0,..., iV — 1 is the translation (or time-shift) operator. We emphasize that all the operations made in 
the index set {0,..., iV — 1} are in the sense of the group that is, modulo N. 

For every g 7 ^ 0, the Gabor system is actually an iVH^jp-tight frame |5T]. The coherence of this frame, 
however, depends strongly on the properties of the generator. It is therefore of interest for many applications 
to search for “optimal” generators. 

2.2. Definition and coherence properties. We will now be investigating the Gabor frame (and later 
its generalization to a fusion frame), which is generated by a characteristic function of a difference set, a 
construction coming from combinatorial design theory and defined in details below. 

Definition 2.3. A subset /C = {ui,... ,uk} of is called an {N,K,X) difference set, if the K{K — 1) 
differences 

(itfc — ui) mod N, k I, 

take all possible nonzero values l,2,...,iV — 1, with each value exactly A times. 

Example 2.4. Let N = 7. The subset /C = {1,2,4} is then a (7,3,1) difference set. We can check this by 
considering all possible differences modulo 7, displayed in the following diagram: 


- 

1 

2 

4 

1 

- 

6 

4 

to 

1 

- 

5 

4 

3 

2 

- 


This confirms that indeed every value from 1 to 6 appears exactly one time. For many other examples of 
difference sets, parameters for which they do not exist and open questions, see the La Jolla Difference Set 
Repository http: //www. ccrwest. org/ds . html 

Given a difference set /C with parameters {N, K, A) we denote by G its characteristic function: 

\o, ifj^/C. 

By we denote the Fourier transform of y,., which for a general window g G is defined as g(j) = 
9 {k)e^^ , for } = 0,..., iV - 1. 

We next note some basic, but important properties of difference sets. 

Proposition 2.5. Let K. be a difference set with parameters {N, K, A). Then the following is true: 

(i) K{K-1) = X{N-1), 

(ii) X<K, 

(iii) = K - X, for all j gZn\{0}, 

(iv) Alc(O) = K. 
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Proof. The claim in (i) comes just from a counting argument: On the one hand, there exist K{K — 1) 
differences in total, and on the other hand, there are — 1 numbers that need to appear A times. 

Once we have this, for (ii) we need to check that < K. This inequality is equivalent to K{K— 1) < 

K{N — 1), which is always true since K < N. 

Finally, for the Fourier transform, we evaluate 

E X-^ —2-Ki{k-k')j 

1+ ^ e ^ 


k.k'^K 


— 2-7Tikj 2 tv ik ,j 

—77-e—Tv— 


= E 

k,k'^K 


— 27Ti(k — k')j 

e ^ 




k.k'^K, 

k^k' 


= K 


N-l /N-1 

-2-Kijl 

e = K -\-X 


^E 


e=i 


E 

e=o 


-2-Kiie 

e ^ — 1 


= K — X, when j 0. 


For j = 0, we have j^(0) = iF, proving (iv) 


□ 


Let /C be a difference set with parameters (TV, /F, A) and consider the normalized vector v := € 

11II v K 

. We will denote by the Gabor system generated by v, 

(4) 

For short, we will call the Gabor system generated by 1C. 

Consider the TV x TV^ matrix whose columns are the elements of the Gabor system ©• We also denote 
this matrix by . Further, we write as a block matrix, 

= [Bq Bi ... Bff-i] , (5) 

where each Bk is a square submatrix of size TV x TV with columns of fixed translation, i.e.. 


Bk = [MoTkV MiTkV M2TkV ... MN-iTkv] . 


Example 2.6. Let TV = 7, and let w = If we consider the difference set from Example 12.41 the 

corresponding matrix <I>^, with not normalized columns for simplicity, will have the form 


■ 0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 


1 

1 

1 

1 

1 

1 

1 

1 

UJ 





a;6 

0 

0 

0 

0 

0 

0 

0 


1 

UJ 


w3 




1 


0.4 


UJ 



1 




UJ 

^3 



0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 





UJ 



1 

^3 




UJ 


1 


Ul 

wS 




0 

0 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 



UJ 





0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 

0 

0 


Going back to the general construction and the investigation of its coherence, we note that the Gram 
matrix of 4),^, which is defined as G = is closely related to the mutual coherence. Namely, 


/x(4>) = max|G(T,j)l • 


( 6 ) 


For our Gabor system, using the notation from the Gram matrix can be written in the block form 



■ B* - 



■ B*Bo 

B*oB, ■ 

BqBm-1 

G = 

Bl 

[Bo Si • 

to 

1 

II 

BlBo 

BtBi ■ 

SiSjv-i 


ID* 



_B^_iBo 

B%-iBi ■ 

B*j.^_iBn-i_ 


We will next state a property of the diagonal blocks in G, which will later turn out to be useful. 


Proposition 2.7. Under the notation given above, we have that 




\j A'(A-l)’ 3 ¥= 

1 , if 3=^, 
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for all k, j,£ = 0,..., N — 1. In particular, the diagonal blocks BqBq, B*Bi, ..., B^_^Bi,!-i are all equal 
in absolute value. 


Proof. We will first prove that any entry of the blocks B^Bk, k = 1,..., iV — 1 is equal in absolute value 
to the corresponding one in the first block BqBq. Let k be some element from {1, 2,..., — 1}. Using the 

definition of Bk and the basic properties of translation and modulation operators, we have 


\BlBk{j,i)\ = \{MeTkV,M,Tkv)\ = \{e^^TkMiV,e^^TkM,v)\ = \{MiV,Mjv)\ = \B*Bo{j,i)\, 
for all j, £ = 0,1,..., — 1. Now, according to the definition of Bq and Proposition 12.51 (iii)|(iv) 

1 




K 


E' 

fcG/C 


27ri(l-j)k 


= ■^\XkU-^)\ = 


K ^ “ \J K{N-1) if i 

1 if j = £. 


□ 


Remark 2.8. Note that, for each k = 0,..., N — 1, Proposition 12.71 savs that the collection of N vectors 
{MoTkV, MiTkV ,..., MN-iTkv} which spans a AT-dimensional subspace of C^, has coherence achieving the 
Welch bound. Therefore, by [5^ Theorem 2.3], {MoTkV, MiTkV ,..., Mpf-iTkv} is an ETF for the subspace 
it spans, for every k = 0,... ,A^ — 1 and it has frame bound Note, that this result was proven in m 
Theorem 1], where equiangular tight frames are called maximum-Welch-bound-equality (MWBE) codebooks. 
It is unclear at this point, however, what the absolute values of the entries in the off diagonal blocks are. As 
we will see in the next theorem, they will depend on the value of A, and thus the mutual coherence of 
will depend on the parameters of the difference set /C. 


Theorem 2.9. Let be a Gabor system generated by an {N,K,X) difference set K. Then, 




N-K 
K{N-1) ’ 




N-l ’ Y K(N-1) 


-I'll’ 


if\ = l, 

ifX^l. 


Proof. According to the described block structure of and by (O, the mutual coherence is 

=max{max|B;5,(j,£)|, max|B*BoO’,£)|}. 

r^q 

jX 

We have already investigated the diagonal blocks in Proposition 12.71 Next we write explicitly the elements 
of the Gram matrix G in the off-diagonal blocks as 


£)| = \{MiTgV,M,Trv)\ = \{Mev,T^r-q)M,v)\ 


N-l 

1 


y v{k)e v{k — {r — q))e " 

“ 'k 

E ® ^ 


keK 

k—(i — q')G/C 


1 

K 


E 

fee/c 


2,vi(e-j)k 

e —w- 


( 8 ) 


fe—(r—Ij)e/C 

We can simplify this expression further dependent on the properties of the difference set 1C. We thus consider 
two separate cases. 
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Case A = 1. In the final sum ([8|), in the case q ^ r, since A = 1, there can be only one k £ }C, such that k 
and k — (r — q) are both in /C. This is because there is only one way to write r — g as a difference of elements 
in 1C, and k — {k — (r — q)) is such a difference. Thus, we can continue (IH|) to obtain 




1 

Ic 


27 ri(£-j)fc 

e « 


1 


when q ^ r. 


Further, by Proposition l2.71 ()\ = Therefore, when A = 1, = max{-^, ^ = 

/ N-K 
V K{N-1)- 

Case A 7 ^ 1. We will estimate maxr^^qj,^ \ BlBq{j,€}\. For fixed r ^ q, since /C is a {N,K, A) difference set 
we have that {k £ 1C : k — {r — q) £ 1C} is a set of exactly A elements. Then, from (|S]) it follows that for all 
j,/ = 0,... ,iV - 1, 

\B:Bq{j,i)\ < A 

Note that when j = i, also by ([5]), \B*Bq{j,j)\ = Thus maxr^qj^i \B*Bq{j,i)\ = Now we just use 
the fact that K{K — 1) = X{N — 1) to rewrite as □ 


Remark 2.10. Although the value ywas optimal for the case of N vectors in K dimensional space, 

for the full Gabor frame the optimal Welch bound will be different. Namely, for a system of N'^ vectors 
in N dimensional space, the Welch bound is 


N^-N 


M = 


N{N'^-1) MN + I' 


Below we present a table with several families of difference sets and the mutual coherence of the corresponding 
Gabor systems. For more details on the construction of these difference sets see [55]. 


Family 

{N,K,X) 



Singer, d = 2 

(g^ + g + 1, g + 1, l) 

q 

(9+1)2 

1 

g2 + g + 2 

Singer, d> 2 

/qd+i _ 1 qd_^ qd-l _ 

( 9 " - 9 )" 

9-1 

V g-1 ’ g-1 ’ 9-1 J 

g2(g^ — 1)2 

gd+l _|_ g _ 2 

Quadratic, q > 7 

( q-\ q-‘X\ 

2 ' A ) 

1 1 

1 

9 + 1 

Quartic, p < 57 

( p-l p + 2,\ 

4 ’ 16 j 

3p+l 

(p-l)2 

1 

P + 1 

Quartic, p > 57 

f p-l p + 3\ 

4 ’ 16 j 

(p-5)2 

16(p- 1)2 

1 

P + 1 


From this table it can be seen that the mutual coherence is not as close to the optimal bound, as it 
was established, for example, for the Alltop vectors in [23]. It is still going asymptotically to zero as the 
dimension grows for the Singer family, and, as we will see in the numerical experiments, the performance of 
the difference sets and the Alltop vectors for the sparse recovery problem are almost identical, making our 
construction still interesting for applications. 
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Reaching the Welch bound is important not only for signal processing, but actually for many other fields, 
including quantum mechanics, where ETFs of elements in dimension N are known as SIC-POVMs (sym¬ 
metric informationally complete positive-operator valued measure). It is in fact an open problem whether 
they exist for every dimension (Zauner conjecture |26]b Particular examples are also difficult to construct, 
and known only for certain values of N. 

From our reasoning above, one might conclude that it is possible to get a Gabor FTF by choosing 
a difference set with optimal values of the parameters K and TV, such that = /r*. Constructing a 

difference set with prescribed parameters is however itself a very difficult and open problem in combinatorial 
design theory. It is also directly connected to the optimal Grassmannian packing problem m- Up to now 
only constructions with certain pairs of parameters {N, K) are known. In any case, we will show that, 
unfortunately, combinations of parameters of difference sets such that corresponding Gabor system achieves 
the Welch bound can not exist. Such hope was probably too good to be true, since for illustration, for 
= 17 an analytical example of a generator which gives an FTF of iV^ lines in dimension N was provided 
in [12], but it took over 40 pages to write its expression down. 

Proposition 2.11. Let TV > 3. Then, there can not exist an (N,K,X) difference set such that the corre¬ 
sponding Gabor system will form an equiangular tight frame. 


Proof. By Theorem 12.91 the mutual coherence can take only one of the two possible values: 


N - K 


K -I 


or 


VK{N-1) N-V 

We will now consider these two cases separately. 

Let us first assume that If want to reach the Welch bound, we need to solve 

K(N-i) = Iv^’ which implies K = From Proposition 12.51 we know that the corresponding A in this 

case is However, for this set of parameters (A^, when A^ > 3, it is easy to check that 

the mutual coherence is actually max | jrik | = from the Welch bound 

M* = \J JT+l- II I® interesting to note that, when N = 3, potential difference sets with parameters (3, 2,1) 

will achieve the Welch bound. An example for such a difference set is /C = {0,1} . Its characteristic function 
g = [l 1 O] (which is a member of a continuous family of generators presented in [T2|) forms a Gabor 
frame of 9 elements which is an FTF. 

Let us next see what happens if we want to reach the Welch bound with the other value, i.e. to have 
(^5 t) = Iv^- 1'°’^ positive K this equation is solved by AT = But for such K and 

N > 3, the mutual coherence will actually be instead of and thus again we can not reach the 

Welch bound. Note that when TV = 3, AT in the obtained solution is again 2. Actually, “ 


/7v+T 


= i, and thus we again achieve the Welch bound. 


□ 


3. Fusion frames coming from difference sets 

We now move to the second part of the paper, where we aim to investigate our collection of time-frequency 
shifts of a difference set from a perspective of fusion frames, which are collections of subspaces and generalize 
the notion of frames. Constructing fusion frames with prescribed “frame-like” properties is an important and 
challenging task. We will show how our Gabor system can be seen as a fusion frame, and that it moreover 
satisfies certain optimality properties which will be discussed further. We now recall the definition of fusion 
frames m, in our case considered with all weights equal to one. 
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Definition 3.1. A family of subspaces in is called a fusion frame for C^, if there exist A and 

B,0<A<B<oo such that 

M 

MAM < X] \\PAA\M < B\\AM for all X G c^, 

where for each i = 0 ,..., — 1, Pi denotes the orthogonal projection of onto Wi¬ 

lt A = B is possible, then {Wi}f£i is called an A-tight fusion frame. Tightness is an important property, 
required for example, for minimization of the recovery error of a random vector from its noisy fusion frame 
measurements [19]. Among other desirable properties are equidimensionality and equidistance. They provide 
maximal robustness against erasures of one or more subspaces, and as we will see later, yield optimal 
Grassmannian packings m- Equidimensionality means that all the subspaces {Wi}f£i are of the same 
dimension, while to define equidistant fusion frames, we need the notion of chordal distance. 

Definition 3.2. Let Wi and W 2 be subspaces of with m := dimWi = dimyV 2 and denote by Pi the 
orthogonal projection onto Wi, i = 1,2. The chordal distance dc(Wi, W 2 ) between Wi and W 2 is given by 

dl{Wi,W2)=m-W[P^P2], 

where Tr denotes the trace of an operator. Multiple subspaces are called equidistant, if they have pairwise 
equal chordal distance dc- 

ft was shown in |19j that equidistant tight fusion frames are optimal Grassmannian packings, where opti¬ 
mality comes from the classical packing problem: For given m, M, N, find a set of m-dimensional subspaces 
{Wi}f£^ in such that mini^j dc{Wi,Wj) is as large as possible. In this case we call {Wi}f£^ an optimal 
packing. An upper bound is given by the simplex bound 

m{N — m)M 
N{M-l) ■ 

This is to some extent analogous to the Welch bound from the classical frame theory, and we will see that 
fusion frames generated by difference sets actually achieve the simplex bound. 

We will investigate the family of subspaces arising from Gabor system of difference sets, defined as follows. 
Let /C be a difference set with parameters {N, K, A) and let v = -^Xjc be our generator for the Gabor system 

d>, = 

For every i = 0,..., iV — 1, let the subspaces Wi be defined as 

Wi = spa,n{MjTiv}^^A = {x & ■ supp(a;) = 1C + i}. (9) 

We call y\4 = {Wi}f^i a Gabor fusion frame associated to a difference set K.. The fact that this family of 
subspaces is in fact a fusion frame (and more over tight) will follow from the next proposition. 

Proposition 3.3 (Corollary 13.2 in |5]). Let {WiffL^ be a family of subspaces in C^. Let {4>ij}jLi be an 
A-tight frame for Wi for each i. Then the following conditions are equivalent. 

(i) {Wi}ffi is a C-tight fusion frame for . 

(ii) {4'ij}iAi)=i is an AC-tight frame for <C^. 

Theorem 3.4. The family of subspaces y\4 = defined in ^ is a IC-tight fusion frame. 

Proof. This property follows directly from Proposition 13.31 First of all, as noted in Remark 12.81 for every 
fixed i, {MjTivf^cA is ^ (also equiangular) frame for Wi. Also, the full system {MjTiv}^~fQ is a 

W-tight frame for . Thus, according to Proposition 13.31 this is equivalent to being a if-tight 

fusion frame for C^. □ 
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3.1. Equidistant fusion frames. We saw that our construction produces tight fusion frames consisting of 
equi-dimensional subspaces. Next, we will show that they moreover have equal pairwise chordal distance. 

Theorem 3.5. The Gabor fusion frame associated to an {N,K,X) difference set K, is an 

equidistant fusion frame with 

. K{N-K) 


di = 


TV- 1 


Proof. Let and be any two different subspaces from (0. To compute d'^{yVij^,Wiff we require 


TifPi^Pi^] = where is the canonical basis of C^. For this, first note that 

P^k XI P^kMjv)Ti^MjV = ^ X TiuMjV, fc = 1, 2. 


T=o 


This leads to 

N-l 


'^{Pi^ee,Pi,ee) = ^ X^X MjT,^v{£) ^ Mj,Ti^v{£) MfTi^v) 


3=0 


N-l 


e=o 


TV2 

K 

TW 


e=o 3=0 j'=o 

2 A-lA-lA-l 

XXX MjTi^v{£)Mj>Tij^v(£)(MjTi^v, MjrTi^v) 


£=0 3=0 j'=0 
N-l 


N-l 


K'^ K'^ 

Jp X ^^3'TnV,MjT,p){MjT,p,Mj.Tip) = — ^ \{MjTip,Mj,T,p)\‘ 

3J'=0 3,3'=0 


® 1 

~ Jp 


A-1 

X 

3,3'=0 


X 


27Ti{j'-j)k 


fce/c 


N-l 


TV2 


X -/)P, 


( 10 ) 


3,3'=0 


where = {fc £ /C : fc — (ii — T 2 ) € /C}. As we have noted before, ca.T:d{Ki^-iff = A. For fixed j, by 

Plancherel’s Theorem, we have 


N-l 


X O’ - /)!' = \\T 3 XK..,-.. f = f = N\\xk.^_,^ f = TVA. 

j'=0 

Now we can go back to the sum m, and get the final result, 


N-l 


N-l 


X {Pi2ei,Piiee) = Jp'^ = 


1=0 


3=0 


Notice that this value does not depend on the choice of the subspaces. Thus, taking into account that our 
subspaces have dimension K, by definition of chordal distance we obtain 

dl=K- Tr[PiP2] = K-\. 


Finally, by Proposition 12.5l[(ii)| the claim follows. 


□ 

Corollary 3.6. The Gabor fusion frame = {Wfe}X)^ associated to an {N,K^X) difference set K, is an 
optimal Grassmannian packing of N K-dimensional subspaces in . 


Proof. By Theorem 13.51 is a fusion frame of equidimensional subspaces with pairwise equal chordal 
distances dc. It was proven in [m Theorem 4.3], that in this case the fusion frame is tight, if and only if 
d^ equals the simplex bound. We already know from Theorem 13.41 that our fusion frame is tight, hence the 
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claim follows. We can also check that the simplex bound is achieved. For this set of parameters, the simplex 
bound equals 

K{N - K)N _ K{N - K) 

N{N -1) ~ N-1 ’ 

and this is exactly d^. Thus, we have an optimal packing. □ 

3.2. Optimally sparse fusion frames. The notion of optimally sparse fusion frames was introduced in 
[7] and means that all subspaces can be seen as spans of orthonormal basis vectors that are sparse in a 
uniform basis over all subspaces, and thus only few entries are present in the decomposition. This different 
optimality property is of great practical use when the fusion frame dimensions are large, and low-complexity 
fusion frame decomposition is desirable. We will show that our Gabor fusion frames defined in dHl) are also 
optimally sparse. 

Definition 3.7. [7] Let {Wz}^i be a fusion frame for with dimWi = rrii for all i = 1,...,M and 
let {'CjljLi be an orthonormal basis for C^. If for each i G {1,..., M}, there exists an orthonormal basis 
{4>i,i}T=i for Wi with the property that for each £ = 1, ..., Wi there exists a subset Ji^i C {!,..., N} such 
that 

M rrii 

4>i,i S span{uj : j G Jij} and 

£=1 

we refer to as an associated k-sparse frame. The fusion frame is called k-sparse with 

respect to if it has an associated fc-sparse frame and if, for any associated j-sparse frame, we have 

k < j. 

Definition 3.8. [7] Let FT be a class of fusion frames for C^, let {VVi}^i G FT, and let be an 

orthonormal basis for C^. Then is called optimally sparse in FF with respect to {vj}^^i, if 

is A:i-sparse with respect to and there does not exist a fusion frame {Vi}fli G FF which is fc 2 -sparse 

with respect to with fc 2 <k\. 

Let FF{M,m,N) be the class of tight fusion frames in which have M subspaces, each of dimension 
m. One example of optimally sparse fusion frames in this class is the spectral tetris construction (STFF), 
explained in more details in [7] and Chapter 13]. For this fusion frame the following theorem is known. 

Theorem 3.9. [7] Let N, M, and m be positive integers sueh that > 2 and < M — 3. Then 

the tight fusion frame STFF N) is optimally sparse in the class FF{M,m, N) with respect to the 

canonical basis in . 

In particular, this tight fusion frame is mM + 2{N — gcd{Mm, N))-sparse with respect to the canonical 
basis. 

We will now show that the Gabor fusion frames generated by difference sets are also optimally sparse in 
the corresponding class of tight fusion frames. 

Theorem 3.10. Let V\4 = {y^k}kFo ^6 ike Gabor fusion frame associated with a difference set K, with 
parameters {N,K,X). Then, V\4 is an optimally sparse fusion frame in the class FF{N,K,N) with respect 
to the canonical basis with sparsity KN. 

Proof. From Theorem 13.41 we know that is a tight fusion frame from the class FF (TV, K, N). 

Let {ej}^_i be the canonical basis of C^. From the definition of (0) it follows that the elements of 
each subspace Wi are supported on the sets 1C + i. Therefore, as an orthonormal basis for every Wi we can 
take 

where (fi/ = efc^+j,/c£ € /C. 
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Then, the corresponding sets Jij from Definition 13.71 are each of cardinality 1, and the sparsity of V\4 is 

N K 

i=l t=l 

Now, for any other associated j-sparse frame with sets we have that Efci Efci \JiA ^ 

because each Ji^i has at least one element. Thus, 14^ is A"iV-sparse. Moreover, this also says that KN is 
the smallest sparsity that one can expect in K, N). Therefore, V\4 is optimally sparse. □ 

Remark 3.11. For AT > 2, AT < iV — 3, we have by Theorem 13.91 that STFF [N,K,N) is optimally sparse 
in RR{N, K, N). Note that in this case the sparsity given by Theorem 13.91 KN + 2{N — gcd(NK, N)) is 
exactly KN. 


4. Numerical experiments 

In this section we test our two constructions based on difference sets: Gabor frames and Gabor fusion 
frames, on recovery of sparse signals from given Gabor-like measurements. 

4.1. Classical sparse recovery. We aim to recover an unknown sparse (having small number of nonzero 
entries) vector x G from its linear measurements y = where is the N x N"^ Gabor system 

generated by g € C^. Recovery of sparse signals from linear measurements is the classical compressed 
sensing setup [5]. To recover x we will traditionally use Basis Pursuit (BP) [11) . which is the convex problem 
given by 

min ||x||i subject to x = y. 

We solve this problem with CVX, a package for specifying and solving convex programs m- We want to 
compare the results of recovery of sparse vectors using three different types of generators for 4>g : Alltop 
vectors [T], complex random vectors and difference sets: 

gA : Alltop vector. gx(j) = for prime N > 5. 

gn : Random vector, gnij) = j where ej are independent and uniformly distributed on the torus. 

gx : Difference set. gx = -^Xk. some {N,K,X) difference set JC. 

We have chosen Alltop and random generators, since their Gabor frames have already proven to be successful 
for sparse recovery both theoretically and numerically [22] . The theoretical guarantees come from the near 
optimality of the mutual coherence of these Gabor systems. We would like to see how the difference sets 
compare to their performance, despite their theoretically non-optimal coherence. 

In the numerical experiment in FigurelU we have chosen = 43 (a prime which gives 3 modulo 4, suitable 
for difference sets of the Quadratic family that we will use). For fixed sparsity level k, we generate a random 
fc-sparse vector x € , with k non-zero values x(j) = rj exp(27rf0g), where rj is drawn independently from 

the standard normal distribution Af(0, 1), and 9j is drawn independently and uniformly from [0,1). Then, we 
measure this signal with each of the three Gabor frames, and try to recover it by BP. We count the recovery 
as successful, if the normalized squared error was smaller than 10“®. For every k we repeat this experiment 
T = 500 times, and plot the successful recovery rates in Figure |TJ What we observe here is that all three 
generators have almost identical recovery rate. The complex random generator performs the best since we 
choose a different realization for gx at every experiment, and the difference sets are slightly better then the 
Alltop in the transition level of k. 

The fact that the mutual coherence can not always capture the desired properties of the Gabor frame was 
noted in [4], where average coherence was introduced. To guarantee a successful recovery via BP, certain 
relations between the average and the mutual coherence need to be satisfied. One can show that those 
particular conditions are also not satisfied by the Gabor frame generated by difference sets. Finding the 
correct theoretical explanation of this successful behavior in numerical experiments is an interesting question, 
and we leave it for future investigation. 
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Figure 1 . Sparse recovery from Gabor measurements 

4.2. Fusion frame sparse recovery. Here the task is to use Gabor fusion frame V\4 generated by a differ¬ 
ence set K, for recovery of signals which are sparse in a fusion frame, namely, which have nonzero components 
lying in only few subspaces. In our case that would correspond to having only few translations. A detailed 
theoretical description of this problem for fusion frames in general, and its importance for applications is 
given in [^. Investigations on recovery from random fusion frames were conducted in [3]. 

The problem we are given in short is as follows. Given the condition that x = S Wj has only 

few nonzero components Xj, recover x from its measurements y = Apx, where Ap = {aijPj}^’j^i- Here, 
is the measurement matrix which in our experiment we take to be random Gaussian, and Pj are 
the projections onto the corresponding subspaces Wj . This time x can be found by solving the minimization 
problem 

min ||x|| 2 ,i subject to Apa: = y. (11) 

x^l-L 

The norm which we minimize is the mixed £ 2/^1 norm, which promotes “block” like sparsity, and is defined 
as 

N 

Iklh.i = \\xjh, where x = Xj € Wj. 

j=i 

Although it might not be clear how to numerically solve the described minimization process dm, this can 
be easily accomplished via the standard £i minimization technique, by incorporating the basis vectors for 
each of the subspaces. The details can be found in [^. Here the question is not only what level of sparsity 
are we able to recover, but also, how many measurements n in the matrix Ap we need. At the same time, 
as we will see, the dimensions of the subspaces will play an important role. 

In Figure [5^ we consider an {N, K, A) difference set with TV = 40 and K = 13, which means that 
the dimension of the subspaces is 13, and in the experiment depicted in Figure we set TV = 43 and 
K = 21. For a different number of measurements, as denoted in the legend, and for every sparsity level, 
we generate random fc-fusion sparse vector x (with independent random Gaussian values at k subspaces 
chosen at random). Then, we calculate the measurements y, and try to recover back x by (HID again using 
CVX. We repeat each experiment T = 100 times, and count the recovery as successful, if the normalized 
squared error was smaller than 10“®. The results are presented in Figure [21 We observe that as expected, 
larger number of measurements allows for higher levels of sparsity, but also that when the dimension of the 
subspaces is smaller, fewer measurements are needed to recover the signal. Moreover, if the subspaces are 
of small dimension, and the number of measurements is sufficiently large, we can recover x independently of 
its sparsity level. 
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The theoretical results for this problem, described in [5], are again not sufficient to capture this effect: 
leaving out the details, the fusion coherence, which is defined as 

Ai/(Ap,{Wj^i) =max[|(aj,afc)| • \\PjPkh] 

and guarantees successful recovery, in our case will be equal to the mutual coherence of the Gaussian 
measurement matrix, and will not depend on the fusion frame structure, since one can prove that ||PjPfc ||2 
always equals 1. Therefore, a more subtle measure of coherence is still missing in both problems presented, 
and these questions will be part of future research. 




(a) Difference set with N = 40, if = 13 


(b) Difference set with = 43, if = 21 


Figure 2. Fusion sparse recovery with Gabor fusion measurements 
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